Job Radar. Live notifications. AI processed.
upwork.com 2026-04-30 π‘
πΉ Automated Job Scraper for 3 Sources
π€ Client: πΊπΈ USA Member since 2026-02-17
π° Price: ****
π© Problem: Collect and update full-time job listings from three selected sources.
π¦ Existing: Not specified
Specifications:
[Target] Collect full-time jobs from 3 predefined sources daily.
[Method] Use web scraping techniques to extract data.
[UI/UX] Not applicable (backend task).
[Stack] Python, BeautifulSoup, Selenium, PostgreSQL for storage.
[Security] Ensure compliance with source terms of service; use proxies to avoid IP blocking.
[Format] JSON for structured output.
Workflow:
1. Define and agree on the three job sources.
2. Set up web scraping tools (e.g., Python, BeautifulSoup, Selenium) to extract data from agreed-upon sources.
3. Implement filters to collect only full-time roles.
4. Store collected data in a PostgreSQL database for easy querying and updates.
5. Schedule the scraper to run 24/7 using cron jobs or similar scheduling tools.